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1 . A system for simulating a real tool in which a computer displays data based upon 
a selected portion of an image printed on an off-line medium, said system comprising: 

a probe device comprising at least a hand-held probe section, said probe 
device transmitting information of said selected portion to said computer; 

a computer storage medium, said storage medium retaining real tool data, 
said real tool data representative of an output of a real tool examining a selected portion 
of an actual item corresponding to said selected portion of said image, and 

wherein said computer retrieves real tool data synchronized to said 
position and displays said real tool data. 

2. A system for simulating a real tool in which a computer displays data based upon 
a selected portion of an image printed on an off-line medium, as per claim 1, wherein said 
off-line medium includes a plurality of icons printed thereon, each of said icons 
indicating a different real tool, selection of an icon by said hand-held probe part changing 
said multimedia data synchronized with a portion of said image so as to be representative 
of an output of the real tool indicated by said icon. 

3. A system for simulating a real tool in which a computer displays data based upon 
a selected portion of an image printed on an off-line medium, as per claim 1, wherein a 
computer display includes a plurality of icons printed thereon, each of said icons 
indicating a different real tool. 
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1 4. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 1, wherein said 

3 real tool is any one of a telescope, spectrum analyzer, radio telescope, magnetometer, 

4 scale, seismometer, ground penetrating radar, x-ray, pH device, thermometer, 

5 stethoscope, electrophoretic device, Geiger counter, chemical assay device, book reader, 

6 word pronouncer, book translator, or dictionary 

1 5. A system for simulating a real tool in which a computer displays data based upon 
O 2 a selected portion of an image printed on an off-line medium, as per claim 1, wherein said 
jf: 3 hand-held probe includes a camera to capture said selected portion. 

SI 1 6. A system for simulating a real tool in which a computer displays data based upon 

^ 2 a selected portion of an image printed on an off-line medium, as per claim 5, further 

r; 3 including image retrieval means to match said sampled image to stored reference images. 

Ml 7. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 5, further 

3 including position determination means to determine relative position of said sampled 

4 image to said reference image. 

1 8. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 1, wherein said 

3 hand-held probe section is a bar code reader and said off-line medium has a plurality of 
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4 bar codes printed thereon juxtaposed with said image, each of said bar codes designating 

5 position data such that said bar code reader reads one of said bar codes, transmits data 

6 representative of said bar code, and said computer retrieves and displays data 

7 synchronized to said bar code. 

1 9. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 8, wherein said 

3 bar codes are printed on an overlay superimposed on said off-line media. 

1 10. A system for simulating a real tool in which a computer displays data based upon 

hj 2 a selected portion of an image printed on an off-line medium, as per claim 8, wherein said 

Si 3 bar codes are printed utilizing infrared ink. 

c. 

fR 1 11. A system for simulating a real tool in which a computer displays data based upon 

yQ 2 a selected portion of an image printed on an off-line medium, as per claim 1, wherein said 

H 3 probe device transmits position information such that said displayed data continuously 

4 changes synchronously to said hand-held probe parts movement across said image. 

1 12. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 11, wherein 

3 said probe device is a digitizer using magnetic fields to determine the hand-held probe 

4 position. 



Page 31 o/38 




ARC920000049US1 

1 13. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 11, wherein 

3 said probe device is a digitizer using electric fields to determine the hand-held probe 

4 position. 

1 14. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 13, wherein 

3 said probe is part of a human hand. 

1 15. A system for simulating a real tool in which a computer displays data based upon 

2 a selected portion of an image printed on an off-line medium, as per claim 1 1 , wherein 

3 said probe device is a digitizer using ultrasonic sound to determine the hand-held probe 

4 position. 

1 16. A system in which electronic media to be presented by a computing device is 

2 synchronized to a selected region of off-line medium, said system comprising: 

3 a hand-held imager, said imager detecting a region of said off-line media 

4 and transmitting an electronic representation of said region to said computer; 

5 a presentation device, said presentation device presenting electronic 

6 media, synchronized to said region of off-line media. 
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1 17. A system in which electronic data to be presented by a computing device is 

2 synchronized to a selected region of off-line medium, as per claim 16, wherein said 

3 presentation device is a visual display. 

1 18. A system in which electronic data to be presented by a computing device is 

2 synchronized to a selected region of off-line medium, as per claim 16, further including a 

3 multimedia database wherein multimedia data is synchronized to movement of said hand- 

4 held imager over said off-line media. 

^ 1 19. A system in which electronic data to be presented by a computing device is 

yj 2 synchronized to a selected region of off-line medium, as per claim 16, wherein 

W 

SJ 3 synchronization simulates the functions of real tools. 

J 1 20. A system in which electronic data to be presented by a computing device is 

yB 2 synchronized to a selected region of off-line medium, as per claim 19, wherein real tool is 

N= 3 any one of a telescope, spectrum analyzer, radio telescope, magnetometer, scale, 

4 seismometer, ground penetrating radar, x-ray, pH device, thermometer, stethoscope, 

5 electrophoretic device, Geiger counter, chemical assay device, book reader, word 

6 pronouncer, book translator, or dictionary 

1 21. A system in which electronic data to be presented by a computing device is 

2 synchronized to a selected region of off-line medium, as per claim 16, further 

3 comprising: 
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4 a camera in said hand-held imager, said camera imaging said selected region of 

5 off-line media and outputting a sampled image; 

6 a database, containing digital representations of reference images, said reference 

7 images including selected regions of off-line media; 

8 an image retriever, receiving said sampled image and identifying said sampled 

9 image as a selected region of a reference image in said database, 

10 a position detector receiving said sampled images and outputting position of said 

1 1 sample image in said identified reference image, and 

: : 

/fj 12 wherein said presentation device presents said electronic media based on said 

05 

to 13 position and said identified reference image. 

5 - : 
s . : 

1 22. A system in which electronic data to be presented by a computing device is 

q 2 synchronized to a selected region of off-line medium, as per claim 21, wherein said 

M= 3 electronic media is an image. 

yp 

1 23. A system in which electronic data to be presented by a computing device is 

2 synchronized to a selected region of off-line medium, as per claim 21, wherein said 

3 electronic media is sound, including any of spoken work, music, or sound effects. 

1 24. A system in which electronic data to be presented by a computing device is 

2 synchronized to a selected region of off-line medium, as per claim 21 wherein response 

3 simulates the function of a real tool selected from the list of a telescope, spectrum 

4 analyzer, radio telescope, magnetometer, scale, seismometer, ground penetrating radar, x- 
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5 ray, pH device, thermometer, stethoscope, electrophoretic device, Geiger counter, 

6 chemical assay device, book reader, word pronouncer, book translator, or dictionary. 

1 25. A system in which data to be displayed by a computer is synchronized to a 

2 selected region of an image printed on a off-line medium, as per claim 16, wherein said 

3 image is divided into a plurality of regions, each of said regions having a bar code printed 

4 therein, and is said electronic media representative of an output of a real tool examining a 

5 region of an actual item corresponding to said region of said image detected by a hand- 

O 6 held bar code reader used as said hand-held imager. 

=B 

GJ 
OB 

hj 1 26. A system in which data to be displayed by a computer is synchronized to a 

SI 2 selected region of an image printed on a off-line medium, as per claim 25, wherein said 

3 off-line medium includes a plurality of icons printed thereon, each of said icons 

j\ 4 indicating a different real tool, selection of an icon by said hand-held bar code reader 

q 5 changing said multimedia data synchronized with each bar code printed in a region of 

6 said image so as to be representative of an output of the real tool indicated by said icon. 

1 27. A system in which data to be displayed by a computer is synchronized to a 

2 selected region of an image printed on a off-line medium, said image divided into a 

3 plurality of regions, each of said regions having a bar code printed therein, as per claim 

4 25, wherein said real tool is any one of a telescope, spectrum analyzer, radio telescope, 

5 magnetometer, scale, seismometer, ground penetrating radar, x-ray, pH device, 
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6 thermometer, stethoscope, electrophoretic device, Geiger counter, chemical assay device, 

7 book reader, word pronouncer, book translator, or dictionary. 

1 28. A system in which data to be displayed by a computer is synchronized to a 

2 selected region of an image printed on a off-line medium, said image divided into a 

3 plurality of regions, each of said regions having a bar code printed therein, as per claim 

4 16, wherein said image is an image of a structure of a database and navigation of said 

5 database is synchronized to movements of said hand-held bar code reader over said 

6 image. 

1 29. A method of simulating a real tool in which a computer displays data based upon 

2 a selection of a location of an image printed on a off-line medium by a hand-held probe, 

3 said off-line medium including a plurality of icons printed thereon, each of said icons 

4 indicating a different real tool, said method comprising: 

5 receiving position information representative of a location of said image 

6 printed on said off-line medium said hand-held probe part is pointing to; 

7 determining data synchronized to said location; 

8 retrieving said data, said data representative of an output of a real tool 

9 examining a location of an actual item corresponding to said location of said image 

10 pointed to by said hand-held probe part, and 

1 1 displaying said data. 
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1 30. A method of simulating a real tool in which a computer displays data based upon 

2 a selection of a location of an image printed on a off-line medium by a hand-held probe, 

3 said off-line medium including a plurality of icons printed thereon, each of said icons 

4 indicating a different real tool, as per claim 29, said method further comprising: 

5 receiving icon information representative of one of a plurality of icons 

6 pointed to by said hand-held probe, said icon representative of a real tool; 

7 changing said data synchronized with said location of said image so as to 

8 be representative of an output of the real tool indicated by said icon. 

sssr 

Ml 31. A method of simulating a real tool in which a computer displays data based upon 

s ^f 2 a selection of a location of an image printed on a off-line medium by a hand-held probe, 

ff z 3 said off-line medium including a plurality of icons printed thereon, each of said icons 

O 4 indicating a different real tool, as per claim 29, wherein said real tool is any one of a 

N= 5 telescope, spectrum analyzer, radio telescope, magnetometer, scale, seismometer, ground 

D 6 penetrating radar, x-ray, pH device, thermometer, stethoscope, electrophoretic device, 

7 Geiger counter, chemical assay device, book reader, word pronouncer, book translator, or 

8 dictionary. 
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